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Abstract 

We introduce and study the Split Common Null Point Problem 
(SCNPP) for set-valued maximal monotone mappings in Hilbert spaces. 
This problem generalizes our Split Variational Inequality Problem 
(SVIP) [Y. Censor, A. Gibali and S. Reich, Algorithms for the split 
variational inequality problem, Numerical Algorithms 59 (2012), 301- 
323]. The SCNPP with only two set- valued mappings entails finding a 
zero of a maximal monotone mapping in one space, the image of which 
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under a given bounded linear transformation is a zero of another max- 
imal monotone mapping. We present four iterative algorithms that 
solve such problems in Hilbert spaces, and establish weak convergence 
for one and strong convergence for the other three. 

1 Introduction 

In this paper we introduce and study the Split Common Null Point Problem 
for set-valued mappings in Hilbert spaces. Let Hi and H2 be two real Hilbert 
spaces. Given set- valued mappings E>i : Hi — >■ 2 Wl , 1 < i < p, and Fj : H2 — > 
2 % , 1 < j < r, respectively, and bounded linear operators Aj : Hi 
1 < j the problem is formulated as follows: 

find a point x* G U x such that G C\ p i=x Bi(x*) (1.1) 
and such that the points 
y* = Aj (x*) G U 2 solve G n r j=1 Fj(y*). (1.2) 

We denote this problem by SCNPP(p, r) to emphasize the multiplicity of 
mappings. To motivate this new problem and to understand its relationship 
with other problems, we first look at the prototypical Split Inverse Problem 
formulated in [22| Section 2]. It concerns a model in which there are given 
two vector spaces X and Y and a linear operator A : X — » Y. In addition, two 
inverse problems are involved. The first one, denoted by IPi, is formulated 
in the space X and the second one, denoted by IP2, is formulated in the 
space Y. Given these data, the Split Inverse Problem (SIP) is formulated as 
follows: 

find a point x* G X that solves IPi (1-3) 
and such that 

the point y* = A (x*) G Y solves IP 2 . (1.4) 

Real-world inverse problems can be cast into this framework by making 
different choices of the spaces X and Y (including the case X = Y), and 
by choosing appropriate inverse problems for IPi and IP2. The Split Convex 
Feasibility Problem (SCFP) [20] is the first instance of an SIP. The two 
problems IPi and IP2 there are of the Convex Feasibility Problem (CFP) 
type. This formulation was used for solving an inverse problem in radiation 
therapy treatment planning [2Tl[T7] . The SCFP has been well studied during 
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the last two decades both theoretically and practically; see, e.g., [121 [21] 
and the references therein. Two leading candidates for IPi and IP2 are the 
mathematical models of the CFP and problems of constrained optimization. 
In particular, the CFP formalism is in itself at the core of the modeling 
of many inverse problems in various areas of mathematics and the physical 
sciences; see, e.g., [35] and references therein for an early example. Over the 
past four decades, the CFP has been used to model significant real-world 
inverse problems in sensor networks, radiation therapy treatment planning, 
resolution enhancement and in many other areas; see [18] for exact references 
to all of the above. More work on the CFP can be found in [H [TTJ [131 EE]- 

It is therefore natural to ask whether other inverse problems can be used 
for IPx and IP 2 , besides the CFP, and be embedded in the SIP methodol- 
ogy. For example, can IPi = CFP in the space X and can a constrained 
optimization problem be IP2 in the space Y7 In our recent paper [22] we 
have made a step in this direction by formulating an SIP with a Variational 
Inequality Problem (VIP) in each of the two spaces of the SIP, reaching a 
Split Variational Inequality Problem (SVIP). In the present paper we study 
an SIP with a Null Point Problem in each of the two spaces. As we explain 
below, this formulation includes the earlier formulation with VIPs and all its 
special cases such as the CFP and constrained optimization problems. 

1.1 Relations with previous work and the contribution 
of the present paper 

To further motivate our study, let us look at the various problem formulations 
from the point of view of their structure only, without reference to the various 
assumptions made in order to prove results regarding these problems. We 
put the SCNPPQo, r) in the context of other SIPs and related works. First 
recall the Split Variational Inequality Problem (SVIP), which is an SIP with 
a VIP in each one of the two spaces [22] • Let Hi and I-L2 be two real Hilbert 
spaces, and assume that there are given two operators / : Hi — Y %\ and 
g : H2 — > H2, a bounded linear operator A : %i — > H2, and nonempty, closed 
and convex subsets C C H.\ and Q C H2. The SVIP is then formulated as 
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follows: 

find a point x* G C such that (f(x*),x — x*) > for all x G C (1.5) 

and such that 

the point y* = A (x*) G Q and solves (g(y*),y — y*) > for all y G Q. 

(1.6) 

This can be structurally considered a special case of SCNPP(1, 1). Denoting 
by SOL(/, C) and SOL(#, Q) the solution sets of the VIPs in and (Q|) . 
respectively, we can also write the SVIP in the following way: 

find a point x* G SOL (/, C) such that A (x*) G SOL (g, Q) . (1.7) 

Taking in (Oft - flTB]) C = H u Q = H 2 , and choosing x := x* - /(a;*) G % 
in fll.5p and y = A (x*) — g(A (x*)) G H 2 hi ( II. 6p . we obtain the Split Zeros 
Problem (SZP) for two operators / : Hi — > H\ and g : "H 2 H2, which we 
introduced in [221 Subsection 7.3]. It is formulated as follows: 

find a point x* G %\ such that f(x*) = and g(A (x*)) = 0. (1.8) 

An important observation that should be made at this point is that if we 
denote by iVc (v) the normal cone of some nonempty, closed and convex set 
C at a point v G C, i.e., 

N c (v) := {d en\ (d,y - v) < for all y G C}, (1.9) 

and define the set- valued mapping B by 

B{v):={ M + NcW> (1.10) 
[ (/), otherwise, 

where / is some given operator, then, under a certain continuity assumption 
on /, Rockafellar in (IBJ Theorem 3] showed that B is a maximal monotone 
mapping and B~ l (0) = SOL(/,C). 

Following this idea, Moudafi [13] introduced the Split Monotone Varia- 
tional Inclusion (SMVI) which generalized the SVIP of [22]. Given two opera- 
tors / : Hi — > H\ and g : 7^ — > H2, a bounded linear operator A : Hi — > H2, 
and two set- valued mappings B x : Hi -> 2 Hl and B 2 :H 2 ^r 2 n2 , the SMVI 
is formulated as follows: 

find a point x* G Hi such that G f{x*) + Bi(x*) (1.11) 
and such that the point 
y* = A (x*) G H 2 solves G g{y*) + B 2 {y*). (1.12) 
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With the aid of simple substitutions it is clear that, structurally, SMVI is 
identical with SCNPP(1, 1) (use only two set-valued mappings, i.e., p = r = 
1, and put in fll.lip - fll.12p above, / = g = 0). The applications presented in 
[4~3] only deal with this situation. 

Masad and Reich [JT] studied the Constrained Multiple-Set Split Convex 
Feasibility Problem (CMSSCFP). Let r and p be two natural numbers. Let 
Ci, 1 < i < p, and Qj, 1 < j ' < r, be closed and convex subsets of Hi and 
H2, respectively; further, for each 1 < j < r, let Aj : H\ — > Hi be a bounded 
linear operator. Finally, let Q be another closed and convex subset of Hi- 
The CMSSCFP is formulated as follows: 



This is also structurally a special case of SCNPP(p, r). Another related 
split problem is the Split Common Fixed Point Problem (SCFPP), first intro- 
duced in Euclidean spaces in [25] and later studied by Moudafi pl2j in Hilbert 
spaces. Given operators Z7» : Hi — > Hi, i = 1,2, ... ,p, and 7) : Hi — > Hi, 
j = 1,2, ... ,r, with nonempty fixed points sets Ci, i = 1,2, ... ,p, and Qj, 
j = 1,2, . . . ,r, respectively, and a bounded linear operator A : Hi — > H2, the 
SCFPP is formulated as follows: 

find a point x* G C := n p i=1 Ci such that A fx*) G Q := n r j=1 Qj. (1.15) 

This is also structurally a special case of SCNPPQo, r). 

Motivated by the CMSSCFP of @T], see ffTT3|) - frmj) above, the purpose 
of the present paper is to introduce the SCNPPQo, r) and present algorithms 
for solving it. Following [41j . [31] and [35], we are able to establish strong 
convergence of three of the algorithms that we propose. These strongly 
convergent algorithms can be easily adapted to the SMVI and to other special 
cases of the SCNPP(p, r). 

Our paper is organized as follows. In Section [2] we list several known facts 
regarding operators and set- valued mappings that are needed in the sequel. 
In Section [3] we present an algorithm for solving the SCNPPQo, r) and obtain 
its weak convergence. In Section H] we propose three additional algorithms for 
solving the SCNPPQo, r) and present strong convergence theorems for them. 
Some further comments are presented in Section [51 



find a point x* G fl 
such that 



(1.13) 



x* G nf =1 Cj and Aj (x*) G Qj for each j = 1,2, . . . ,r. 



(1.14) 
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2 Preliminaries 



Let H be a real Hilbert space with inner product (•, •) and induced norm || • ||, 
and let D C % be a nonempty, closed and convex subset of it. We write either 
x k — ^ x or x k — > x to indicate that the sequence converges either 

weakly or strongly, respectively, to x. Next we present several properties of 
operators and set-valued mappings which will be useful later on. For more 
details on many of the notions and results quoted here see, e.g., the recent 

books nung. 

Definition 2.1 Let H be a real Hilbert space. Let D C H be a subset ofH 
and h : D — >• % be an operator from D to %. 

1. h is called v-inverse strongly monotone (v-isra) on D if there ex- 
ists a number v > such that 

(h(x) - h{y),x-y) > v\\h(x) - h(y)\\ 2 for all x,y E D. (2.1) 

2. h is called firmly nonexpansive on D if 

(h(x)-h(y),x-y) > \\h(x) - h(y)\\ 2 forallx,yeD, (2.2) 

i.e., if it is 1-ism. 

3. h is called Lipschitz continuous with constant n > on D if 

\\h(x) - h(y)\\ < k\\x — for all x, ye D. (2.3) 

4- h is called nonexpansive on D if 

\\h(x) - h(y)\\ < \\x - y\\ forallx,yeD, (2.4) 
i.e., if it is 1-Lipschitz. 

5. h is called a strict contraction if it is Lipschitz continuous with 
constant k < 1. 

6. h is called hemi continuous if it is continuous along each line segment 
in D. 
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7. h is called asymptotically regular at x G D JE/ if 

lim (h k (x) - h k+1 (x)) = for all x G H, (2.5) 

k— >oo 

where h k denotes the k-th iterate of h. 

8. h is called demiclosed aty^T-L if for any sequence {x k }^_ Q C D such 
that x k — x G D and h(x k ) — >■ y, we have h(x) = y. 

9. h is called averaged |||/ if there exists a nonexpansive operator N : 
D — > M. and a number c G (0, 1) such that 

h=(l-c)I + cN, (2.6) 

where I is the identity operator. In this case we also say that h is c-av 

10. h is called odd if D is symmetric, i.e., D = —D, and if 

h(-x) = -h(x) for all x G D. (2.7) 

Remark 2.2 (i) It can be verified that if h is v-ism, then it is Lipschitz 
continuous with constant k = 1/v. 

(ii) It is known that an operator h is averaged if and only if its complement 
I — h is v-ism for some v > 1/2; see, e.g., J73| Lemma 2.1]. 

(Hi) The operator h is firmly nonexpansive if and only if its complement 
I — h is firmly nonexpansive. The operator h is firmly nonexpansive if and 
only if h is (l/2)-av (see 13!^ Proposition 11.2] and /73| Lemma 2.3]). 

(iv) If hi and h 2 are c\-av and c 2 -av, respectively, then their composition 
S = h\h 2 is (ci + c 2 — Cic 2 )-av. See ITB] Lemma 2.2]. 

Definition 2.3 Let H be a real Hilbert space. LetB:U^2 n and A > 0. 
(%) B is called odd if 

B(-x) = -B{x) for all x G H. (2.8) 

(ii) B is called a maximal monotone mapping if B is monotone, i.e., 

(u — v,x — y) > for all u G B(x) and v G B(y), (2.9) 
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and the graph G{B) of B, 



G(B) := {(x,u) eUxUlue B(x)} , 



(2.10) 



is not properly contained in the graph of any other monotone mapping. 
(Hi) The domain of B is 



(iv) The resolvent of B with parameter X is denoted and defined by 
:= (/ + \B)~ , where I is the identity operator. 

Remark 2.4 It is well known that for A > ; 

(i) B is monotone if and only if the resolvent Jf of B is single-valued 
and firmly nonexpansive. 

(ii) B is maximal monotone if and only if is single-valued, firmly 
nonexpansive and dom(J_f) = 7i. 

(Hi) The following equivalence holds: 



It follows from ( I2.12p that the SCNPPQo, r) with two set- valued maximal 
monotone mappings (p — r — 1) can be seen as an SCFPP with respect 
to their resolvents. In addition, Moudafi's SMVI can also be considered an 
SCFPP with respect to jf x (J - Xf) and jf 2 (7 - Xg) [HH Fact 1]. Now we 
present another known result; see, e.g., [HH Fact 2]. 

Remark 2.5 Let H be a real Hilbert space, and let a maximal monotone 
mapping B : % — > 2 n and an a-ism operator h : % — > % be given. Then the 
operator J^(I — Xh) is averaged for each X G (0, 2a). 

Next we present an important class of operators, the T-class operators. 
This class was introduced and investigated by Bauschke and Combettes in [31 
Definition 2.2] and by Combettes in [27] • Operators in this class were named 
directed operators by Zaknoon |56j and further employed under this name by 
Segal [17], and by Censor and Segal [22 [25]. Cegielski [H Def. 2.1] studied 
these operators under the name separating operators. Since both directed 
and separating are keywords of other, widely-used, mathematical entities, 
Cegielski and Censor have recently introduced the term cutter operators [15] . 
This class coincides with the class J 71 ' for v = 1 [21] and with the class DC P 



dom(B) :={xen\ B(x) ^ 0} . 



(2.11) 



G B(x*) x* G Fix( Jf). 



(2.12) 
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for p — — 1 (10]. The term firmly quasi-nonexpansive (FQNE) for T-class 
operators was used by Yamada and Ogura [551 G31 Section B] because every 
firmly nonexpansive (FNE) mapping [331 P a g e 42] is obviously FQNE. 

Definition 2.6 Let rl be a real Hilbert space. An operator h : T-L —^"H is 
called a cutter operator if dom(/t) = % and 

(h (x) - x, h (x) - q) < for all (x, q) G U x Fix(h), (2.13) 

where the fixed point set Fix(h) of h is defined by 

Fix(/i) := {x G H | h(x) = x}. (2.14) 

It can be seen that this class of operators coincides with the class of firmly 
quasi-nonexpansive operators (FQNE), which satisfy the inequality 

\\h(x)-q\\ 2 < \\x-q\\ 2 - \\x - h{x)f for all (x, q) E U x Fix(/i). (2.15) 

Note that the T-class operators include, among others, orthogonal projec- 
tions, subgradient projectors, resolvents of maximal monotone mappings, 
and firmly nonexpansive operators. This last class was first introduced by 
Browder [7, Definition 6] under the name firmly contractive operators. Every 
T-class operator belongs to the class J 70 of operators, defined by Crombez 
m P- 161]: 

jro := { h - n H | 11^) _ 5 || < _ 5 || for all ( Xj g ) e n x Fix(/i)} . 

(2.16) 

The elements of J 70 are called quasi-nonexpansive or paracontracting opera- 
tors. A more general class of operators is the class of demicontractive opera- 
tors (see, e.g., [4"0]). 

Definition 2.7 Let H be a real Hilbert space and let h : rl — > rl be an 

operator. 

(i) h is called a demicontractive operator if there exists a number 
(3 G [0, 1) such that 

\\h{x) - q\\ 2 < \\x - q\\ 2 + (3\\x - h(x)\\ 2 for all (x,q) G U x Fix(h). (2.17) 

This is equivalent to 

(x - h(x),x- q) > \\x - h(x)\\ 2 for all (x,q) G rl x Fix(/i). (2.18) 
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Another useful observation, already hinted to above, is that if h : H — > % 
is monotone and hemicontinuous on a nonempty, closed and convex subset 
D, then the set- valued mapping 

is, by [i6l Theorem 3], maximal monotone and M _1 (0) = SOL(/i, D). There- 
fore, as mentioned in [13], if we choose B\ = Nc and B 2 = Nq in (11. lip and 
f)1.12p . respectively, then we get the SVIP of (ll.5l) - (ll.6l) . Of course, this 
assertion also holds for our SCNPPQo, r) with two set- valued maximal mono- 
tone mappings (p — r — 1) when we take B\ and F\ to be similar to M in 
(I2.19p . This enables us to solve the SVIP for monotone and hemicontinuous 
operators (which constitute a larger class than the class of inverse strongly 
monotone operators) by using our convergence theorem for the SVIP [2"2~| 
Theorem 6.3]. In [221 Theorem 6.3] we also assumed [221 Equation (5.9)] 
that for all x* G SOL (/, C), 

(f(x), P C (I - Xf)(x) -x*}>0 for all x G Hi, (2.20) 

an assumption which is not needed for the convergence theorems we establish 
in the present paper. 

The next lemma is the well-known Demiclosedness Principle [6]. 

Lemma 2.8 Let 7-L be a Hilbert space, D a closed and convex subset of H, 
and let h : D — )• H be a nonexpansive operator. Then I — h is demiclosed at 
any y G H. 

The next definition is due to Clarkson [26] . 

Definition 2.9 A Banach space B is said to be uniformly convex if to each 
e G (0,2], there corresponds a positive number 5(e) such that the conditions 
\\ x \\ = WvW = 1 an d \\ x ~ v\\ — £ imply that + y) /2|| < 1 — 5(e). 

It follows from the Parallelogram Identity that every Hilbert space is 
uniformly convex. Next we present two known theorems, the Krasnosel'skii- 
Mann-Opial theorem [371 USE HI] and the Halpern-Suzuki theorem [3^1 H5] . 

Theorem 2.10 \f^\M\4M Let U be a real Hilbert space and D C U be 
a nonempty, closed and convex subset of H. Given an averaged operator 
h : D — >■ D with Fix(h) ^ and an arbitrary x° G D, the sequence generated 
by the recursion x k+1 = h(x k ), k > 0, converges weakly to a point z G Fix(h). 
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Theorem 2.11 f34\ \4^jj Let % be a real Hilbert space and D C "H be a 
closed and convex subset ofH. Given an averaged operator h : D — >■ D, and 

oo 

a sequence {ak}^L C [0, 1] satisfying lim^oo a>k = and a k = the 

k=0 

sequence {x k }^L generated by x° G D and x k+1 = akX° + (1 — ak)h(x h ), 
k > 0, converges strongly to a point z e Fix(h). 

3 Weak convergence 

In this section we first present an algorithm for solving the SCNPPQo, r) 
for two set-valued maximal monotone mappings. Then, for the general case 
of more than two such set-valued mappings, we employ a product space 
formulation in order to transform it into an SCNPP(1, 1) for two set- valued 
maximal monotone mappings, in a similar fashion to what has been done in 
[25l Section 4] and [22j Subsection 6.1]. 

3.1 The SCNPP(1, 1) for set-valued maximal monotone 
mappings 

Consider the SCNPP(jo, r) fll.ip - (ll.2l) with p = r = 1. That is, given two 
set-valued mappings B x : Hi -)■ 2 ni and Fi : H 2 -> 2 % , and a bounded 
linear operator A : 9ii — > H2, we want to 

find a point x* G Hi such that G B^x*) and G Fi(A (x*)). (3.1) 

Here is our proposed algorithm for solving (13. ip . 

Algorithm 3.1 

Initialization: Let A > and select an arbitrary starting point x° G "Hi . 
Iterative step: Given the current iterate x h , compute 

x k+l = jB, ^.k _ lA *(j _ jF^ A ^ ^ ( 3 2 ) 

where A* is the adjoint of A, L = \\A*A\\ and 7 G (0,2/L). 

The convergence theorem for this algorithm is presented next. We denote 
by T the solution set of (13.11) . 
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Theorem 3.2 Let T-Li and "H 2 be two real Hilbert spaces. Given two set- 
valued maximal monotone mappings B\ : Hi — > 2 Hl and F\ : H2 —> 2 H2 1 and 
a bounded linear operator A : Hi — > H2, any sequence {x k j k generated by 
Algorithm \3.1\ converges weakly to a point x* G T, provided that T 7^ and 
7 G (0,2/L), where L = \\A*A\\. 

Proof. In view of the connection between our SCNPP(p, r) and Moudafi's 
SMVI, this theorem can be obtained as a corollary of [HH Theorem 3.1], the 
proof of which is based on the Krasnosel'skh-Mann-Opial theorem [3Tll3~9l l4"4"]. 
■ 

Remark 3.3 Observe that in Theorem \3.S\ we assume that 7 G (0,2/L), 
while in Theorem 6.3], 7 is assumed to be in (0,1/ L), which obviously 
was a more restrictive assumption. 

To describe the relationship of our work with splitting methods, let H be 
a real Hilbert space, and let B : % — > 2 n and F : % — > 2 H be two maximal 
monotone mappings. Consider the following problem: 

find a point x* G H such that G B(x*) + F(x*). (3.3) 

Many algorithms were developed for solving this problem. An important 
class of such algorithms is the class of splitting methods. References on 
splitting methods and their applications can be found in Eckstein's Ph.D. 
thesis [32], in Tseng's work [^9| l50t |5T] and more recently in Combettes et 
al. [281 |29l|30]. 

One splitting method of interest is the following forward-backward algo- 
rithm: 

x k+i = J B(j_ ^ ; ( 3 4 ) 

where F = h is single-valued. Combettes [281 Section 6] was interested in 
( 13. 41) under the assumption that B : H — )■ 2 n and h : H — > Ti are maximal 
monotone, and (3h is firmly nonexpansive (i.e., 1/2-av) for some G (0, 00). 
He proposed the following algorithm: 

x ^ = x k + \ k (J* (x k - lk (h (x k ) + b k )) +a k - x k ) , (3.5) 

where the sequence {7fc}^ is bounded and the sequences {cifc}^l and {bk}^^ 
are absolutely summable errors in the computation of the resolvents. It 
can be seen that the iterative step f)3.2p is a special case of (13 ,4p with 
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h = 7 A* (I — J^)A. In the setting of Theorem 13.21 here, h is 1/ (7-L)-ism 
and therefore for f3 = (^yL)' 1 , the operator j3^A*(I — J^)A is 1-ism, that 
is, firmly nonexpansive. Now by [4, Example 20.27], this operator is max- 
imal monotone. Therefore Algorithm 13.11 is a special case of (13. 5p without 
relaxation and we also need to calculate the exact resolvent. It may be some- 
what surprising that our SCNPP is formulated in two different spaces, while 
( 13. 3 p is only defined in one space and still we arrive at the same algorithm. 
Further related results on proximal feasibility problems appear in Combettes 
and Wajs [291 Subsection 4.3]. 

3.2 The general SCNPP(p,r) 

In view of Remark 12.41 we can show, by applying similar arguments to those 
used in [25], that our SCNPPQo, r) can be transformed into a split common 
fixed point problem (SCFPP) (see (11.151) ) with two operators T and U in a 
product space. Next, we show how the general SCNPPQo, r) can be trans- 
formed into an SCNPP(1, 1) for two set- valued maximal monotone mappings. 

Consider the space H = H\ x H r % , an d the set- valued maximal mono- 
tone mappings D : Hi — >■ 2 ni and F : H — > 2 H defined by D(x) = {0} 
for all x e Hi and F^x 1 , . . . , x p , y 1 , . . . , y r )) = Bi (x 1 ) x . . . x B p (x p ) x 
F\ (y 1 ) x . . . x F r (y r ) for each (x 1 , . . . , x p , y 1 , . . . , y r ) G // In addition, 
let the bounded linear operator A : Hi — > H be defined by A (x) = 
(x, . . . , x, Ai (x) , . . . , A r (x)) for all x G Hi. Then the general SCNPP (p, r) 
(HHD-(H2D is equivalent to 

find a point x G Hi such that G D(x) and G F (A (x)) . (3.6) 

When Algorithm 13.11 is applied to this two-set problem in the product 
space H and then translated back to the original spaces, it takes the following 
form. 

Algorithm 3.4 

Initialization: Select an arbitrary starting point x° G Hi- 
Iterative step: Given the current iterate x k , compute 

* k+1 = * k + 7 ( E (^(^) ~* fc )+E A*(J? - I)Aj (x k )\ , (3.7) 

V i=i j=i J 

where 7 G (0,2/L), with L =p + JJj=i \\ A j\\ 2 - 
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The convergence of this algorithm follows from Theorem 13.21 We may 
also introduce relaxation parameters into the above algorithm as has been 
done in the relaxed version of [121 equation 2.10]. 

4 Strong convergence 

We focus on the SCNPPQo, r) for two set- valued maximal monotone map- 
pings, keeping in mind that for the general case we can always apply the 
above product space formulation and then translate back the algorithms to 
the original spaces. In this section we first present a strong convergence the- 
orem for Algorithm 13 . II under an additional assumption. This result relies on 
the work of Browder and Petryshyn [HI Theorem 5], and on that of Baillon, 
Bruck and Reich [21 Theorem 1.1] (see also [HJ Lemma 7]). Then we study 
a second algorithm which is a modification of Algorithm 13.11 that results in 
a Halpern-type algorithm. The third algorithm in this section is inspired by 
Haue; 's method [33]; see also [3J. 

4.1 Strong convergence of Algorithm [3JJ 

The next two theorems are needed for our proof of Theorem 14.31 We present 
their full proofs for the reader's convenience. 

Theorem 4.1 |21 Theorem 5], ISfitf Let B be a uniformly convex Banach 
space. If the operator S : B — >■ B is nonexpansive with a nonempty fixed 
point set Fix (S) ^ ; then for any given constant c G (0, 1), the operator 
S c := cl + (1 — c)S is asymptotically regular and has the same fixed points 
as S. 

Proof. It is obvious that Fix (S) = Fix (S c ) and that S c is also a non- 
expansive self-mapping of B. Let u G Fix (S c ) and for a given x G B, let 
x k = S k (x). Since S c is nonexpansive and u G Fix (S c ) , it follows that 

||a; fc+1 - u|| < \\x k - u\\ for all k > 0. (4.1) 

Therefore there exists lim^oo ||a; fc — u\\ = £ > 0. Assume that £ > 0. Then 

x fc+1 — u — S k+1 (x) — u — S c (x k ) - u 
= (cI+(l-c)S) (x k )-u 

= c{x k -u) + {l-c)(S{x k )-u). (4.2) 
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Since 

lim \\x k - u\\ = lim ||x fe+1 - u\\ = i (4.3) 

fe— )-oo k— >oo 

and 

Hx^ 1 - u || = \\S(x k ) - u\\ < \\x k - u\\ , (4.4) 
the uniform convexity of B implies that 

lim II (x k - u) - (S{x k ) -u)\\= 0, (4.5) 

i.e., x k — S(x k ) — > 0. Hence x k+1 — x k — > 0, which means that is asymp- 
totically regular, as claimed. ■ 

Theorem 4.2 [2, Theorem 1.1] Let B be a uniformly convex Banach space. 
If the operator S : B — >■ i3 is nonexpansive, odd and asymptotically regular at 
x E B, then the sequence {S k (x)}™_ Q converges strongly to a fixed point of 
S. 

Proof. Since S is odd, S(0) = —S(0) and S(Q) = 0. Since S is nonex- 
pansive, we have by the triangle inequality, 

\\S k (x)\\ = \\S k (x)\\ - \\S k (0)\\ < \\S k {x) - S k (0)\\ 

< \\S k -\x) - S* -1 (0)|| = H^-^a;)!! < • - - < \\x - 0|| = ||x|| , 

(4.6) 

which means that the sequence { ||5' fc (x) || }^ =0 is decreasing and bounded. 
Therefore the limit lim^oo H^^) || exists and, for a fixed i, the sequence 
|||S' A:+l (x) + S k (x) \\}T =0 is decreasing. Let lim^oo H^Oz) || = d. Then by 
the triangle inequality, 

2d < \\2S k (x)\\ = \\S k (x) - S k+i {x) + S k+i {x) + S k {x)\\ 

< \\S k (x) - S k+ \x)\\ + \\S k (x) + S k+i (x)\\ . (4.7) 

Since S is asymptotically regular at x, lim^oo ^\S k {x) — S k+l (x) I = 0. Thus 
lim*-** \\S k (x) + S k+i (x)\\ > 2d. But the sequence {\\S k+i (x) + S k (x)\\}™ =Q 
is decreasing, so that ||5 ,fc (x) + S k+t (x) || > 2c? for all k and i. We now 
have lim^oo ||5 fe (a;)|| = d and lim mjn _j.oo ||S ,n (:r) + S' m (a;)|| = 2d. The uni- 
form convexity of B implies that \im. ni;n ^. 00 \\S n (x) — S m (x)\\ = 0, whence 
\S k (x)} , converges strongly to a fixed point of S. ■ 
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In Theorem 14.31 we need the resolvent to be odd, which means that 

((/ + XB)' 1 ) (-x) = -((/ + XB)' 1 ) (x) for all x G H. (4.8) 

Denote 

((/ + XB)' 1 ) (-x) = y and ((/ + XB)' 1 ) (x) = z. (4.9) 

Then 

- x G y + XB(y) and x G z + XB(z). (4.10) 

If B is odd, then 

x G -y + XB(-y). (4.11) 

Hence — y = z, which is (14. 8ft . Therefore we assume in the following theorem 
that both B\ and F\ are odd. 

Now we are ready to present the strong convergence theorem for Algo- 
rithm 13.11 Its proof relies on Theorem 14.21 

Theorem 4.3 Let Hi and H2 be two real Hilbert spaces. Let two set-valued, 
odd and maximal monotone mappings B\ : Hi — > 2 Hl and F\ : H2 —> 2 n2 , 
and a bounded linear operator A : Hi — > H2 be given. If 7 G (0,2/L), 
then any sequence {x k }^_ Q generated by Algorithm \3.1\ converges strongly to 

x* g r. 

Proof. The operator J^ 1 (J — 7 A* (I — jf 1 )^) is averaged by the proof 
of [131 Theorem 3.1]. Therefore, by [HI Theorem 5] and [36] (see Theorem 
I4.ip . the operator J^ 1 (I — 7^4* (/ — J^A) is also asymptotically regular. 
Since Bi and Fi are odd, so are their resolvents J^ 1 and J^ 1 , and therefore 
Jf 1 (I - j A* (I - J^)A) is odd. Finally, the strong convergence of Algo- 
rithm 13.11 is now seen to follow from Theorem 14.21 ■ 

For the general SCNPP(p, r) we can again employ a product space for- 
mulation as in Subsection 13.21 and under the additional oddness assumption 
also get strong convergence. 

4.2 A Halpern-type algorithm 

Next, we consider a modification of Algorithm 13.11 inspired by Halpern's 
iterative method and prove its strong convergence. Let T : C — > C be a 
nonexpansive operator, where C is a nonempty, closed and convex subset of 
a Banach space B. A classical way to study nonexpansive mappings is to use 
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strict contractions to approximate T, i.e., for t G (0, 1), we define the strict 
contraction T t : C — > C by 

T t (x) = tu + (1 - t)T(x) for x G C, (4.12) 

where u G C is fixed. Banach's Contraction Mapping Principle (see, e.g., 
|33j) guarantees that each T t has a unique fixed point x t G C In case 
Fix(T) ^ 0, Browder [B] proved that if B is a Hilbert space, then x t converges 
strongly as t — > + to the fixed point of T nearest to u. Motivated by 
Browder's results, Halpern [31] proposed an explicit iterative scheme and 
proved its strong convergence to a point z G Fix(T). In the last decades 
many authors modified Halpern's iterative scheme and found necessary and 
sufficient conditions, concerning the control sequence, that guarantee the 
strong convergence of Halpern- type schemes (see, e.g., [381 113 G2J [53], EE]). 
Our algorithm for the SCNPPQo, r) with two set- valued maximal monotone 
mappings is presented next. 

Algorithm 4.4 

Initialization: Select some A > and an arbitrary starting point x° G 

Hi. 

Iterative step: Given the current iterate x k , compute 

X W = a k x Q + (1 - a*)J? (/ - jA*(I - Jf )A) (x k ) , (4.13) 

where 7 G (0,2/L) with L = \\A*A\\ and the sequence {ak}^L C [0, 1] satis- 

00 

fies limfc-j.oo afc = and ^2 = 00. 

Here is our strong convergence theorem for this algorithm. 

Theorem 4.5 Let Hi and Hi be two real Hilbert spaces. Let there be given 
two set-valued maximal monotone mappings B\ : Hi — > 2 Hl and Fi : H2 — > 
2 H2 , and a bounded linear operator A : Hi — > Hi- If T 7^ 0, 7 G (0, 2/L) and 

{afc}^L C [0, 1] satisfies \im.k^ooC*k = and a k = °°; then any sequence 

k=0 

{x k } k _ generated by Algorithm 4-4 converges strongly to x* G T. 

Proof. As we already know, the operator jf 1 (I — ^yA*(I — J^ 1 )A) is 
averaged. So, according to Theorem 12.111 an Y sequence {x k }^ =0 generated 
by Algorithm 14.41 converges strongly to a point in the fixed point set of 
the operator, i.e., x* G Fix (Jjf 1 (I — jA*(I — J^ l )A)) as long as this set is 
nonempty. As in the proof of [HI Theorem 3.1], we conclude that x* G T, as 
claimed. ■ 
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4.3 An Haugazeau-type algorithm 



Haugazeau [35J presented an algorithm for solving the Best Approximation 
Problem (BAP) of finding the projection of a point onto the intersection of 
m closed convex subsets {Cj}™ 1 C H of a real Hilbert space. Defining for 
any pair x, y G % the set 

H{x, y):={ueH\(u-y,x-y)< 0}, (4.14) 

and denoting by T(x, y, z) the projection of x onto H(x, y)C\H(y, z), namely, 
T(x,y,z) = PH(x,y)nH( y ,z)(%), Haugazeau showed that for an arbitrary start- 
ing point x° G "H, any sequence {x k }^L , generated by the iterative step 

x k+1 = T(x°, x k , P k{modm)+1 (x k )) (4.15) 

converges strongly to the projection of x° onto C = n^Cj. The operator 
T requires projecting onto the intersection of two constructible half-spaces; 
this is not difficult to implement. In [35] Haugazeau introduced the operator 
T as an explicit description of the projector onto the intersection of the two 
half-spaces H(x,y) and H(y,z). So, following, e.g., [5., Definition 3.1], and 
denoting n = (x — y,y — z) , /i = ||x — y|| 2 , v = \\y — z\\ 2 and p = \iv — 7r 2 , 
we have 



T(x,y,z) 



z, if p = and ix > 0, 

x + i 1 + u) ( z - 2/)' if p > and 7tz/ > p, ( 4 16 ) 

y + ^(vr(x — y) + p(z — y)), if p > and ixv < p. 



We already know that the operator S := J^ 1 (i — ^A*{I — J^)A) is av- 
eraged and therefore nonexpansive. Now consider the firmly nonexpansive 
operator S1/2 := (/ + S) /2, which according to Theorem 14.11 has the same 
fixed points as 5*. Following the "weak-to-strong convergence principle" [3], 
strong convergence (without additional assumptions) can be obtained by re- 
placing the updating rule (13.21) in Algorithm 13.11 with 

x k+1 = T(x°,x k ,S 1/2 {x k )) 

= P H( y xO,x k )nH(x k ,S 1/2 (x k ))( X °)- (4-17) 

A similar technique can also be applied to the forward-backward splitting 
method in [2S1 Section 6]. 
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Further comments 



Since the SCNPPQo, r) generalizes the SVIP, it includes all the appli- 
cations to which SVIP applies (see [22j Section 7]). In particular, it 
includes the Split Feasibility Problem (SFP) and the Convex Feasibility 
Problem (CFP). Since the Common Solutions to Variational Inequali- 
ties Problem (CSVIP) [23] with operators is a special case of the SVIP, 
the SCNPPQo, r) includes its applications as well. In addition, since all 
the applications of the SMVI presented in [13] are for / = g = in 
( II. lip and (11.121) above, it follows that these applications are also cov- 
ered by our SCNPPQo, r). They include the Split Minimization Prob- 
lem (SMP), which has already been presented in [221 Subsection 7.3] 
with continuously differentiable convex functions, for which we can now 
drop this assumption, the Split Saddle-Point Problem (SSPP), the Split 
Minimax Problem (SMMP) and the Split Equilibrium Problem (SEP). 
Observe that if Hi = H 2 an d Aj = I for for all j = 1,2, ... ,r, then 
we can deal with all of the above applications with "Split" replaced 
by "Common". We can even study mixtures of "split" and "common" 
applications. 

According to Remark 12. 5| the operator Jjf (/ — Xf) is averaged, where 
B : H — > 2 n is maximal monotone, the operator / : H — > H is a-ism 
and A £ (0,2a). Since our convergence theorems rely on the aver- 
agedness of the operators involved, we could modify our algorithms 
and obtain strong convergence for Moudafi's SMVI ( 01. lip and ( II. 12ft 
above). In addition, our algorithms allow us to solve Moudafi's SMVI 
with monotone and hemicontinuous operators / and g (which is a larger 
class than the class of inverse strongly monotone operators). 

Assuming that the set- valued mappings Bx-.Ui^ 2 Hl and B^:H 2 ^ 
are maximal monotone, and / : Hi — > Hi and g : H 2 — » "H 2 are 
ism-operators, Moudafi presented an algorithm that converges weakly 
to a solution of the SMVI. By [46, Theorem 3], the sum of a maximal 
monotone mapping and an ism-operator is maximal monotone. There- 
fore, the SMVI reduces to our set-valued two-mapping SCNPPQo, r). 
In addition, we can phrase the set- valued SVIP for maximal monotone 
mappings in the following way. Given two maximal monotone map- 
pings Bi : Hi — > 2 n± and B 2 : Hi — > 2 H2 , a bounded linear operator 
A : Hi — > H2, and nonempty, closed and convex subsets C C Hi and 
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Q C %2i the set- valued SVIP is formulated as follows: 

find a point x* G C and a point u* G Bi(x*) 
such that (it*, x — x*) > for all x G C, 
and such that 
the points y* — A (x*) G Q and i>* G B 2 (y*) 

solve (u*, y - y*) > for all y G Q. (5.1) 

It is clear that if the zeros of the set- valued mappings B\ and B 2 are in 
C and Q, respectively, then they are solutions of the set-valued SVIP, 
but in general not all solutions are zeros. 
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